Configuring an audio interface with contingent microphone setup

ABSTRACT

A method for configuring an audio interface for a speech recognition application in a computer system comprises the steps of: (a) determining from a data storage registry of said speech recognition application whether a microphone operatively associated with said computer system has been previously successfully set up for operation with said speech recognition application; (b) displaying a first graphical user interface having a first user activatable icon for setting up said microphone and a second user activatable icon for adjusting an audio recording level for said microphone; (c) in the event said microphone is not registered as having been previously successfully set up, altering said second icon in appearance and disregarding attempted activation of said second icon; and, (d) in the event said microphone is registered as having been previously successfully set up, respectively initiating said setting up of said microphone and said adjusting of said audio recording level responsive to activation of said first or second icons respectively. The method can further comprise the steps of: (e) setting up said microphone responsive to activation of said first icon in any one of steps (c) and (d) in conjunction with displaying at least one additional graphical user interface; and, (f) redisplaying said first graphical user interface as recited in step (b).

BACKGROUND OF THE INVENTION

1. Field of the Invention

The invention relates to the field of configuring microphones and audiosystems in computer systems, and in particular, to a method andgraphical user interface for configuring one or more microphones, one ormore speakers, one or more sound cards and one or more audio mixers foruse with a speech recognition application.

2. Description of Related Art

The use of microphones in connection with personal computers hasincreased in popularity due to the advent of inexpensive multimediacomputers and sophisticated applications like collaboration on theInternet, telephony and speech recognition.

Proper microphone connection and audio settings are among the mostimportant elements in achieving required performance from the audiocomponents of a computer, especially for speech recognition. Tools thathelp unskilled users properly configure and adjust their microphone andaudio settings are important differentiators for these types ofapplications.

SUMMARY OF THE INVENTION

The inventive arrangements taught herein provide numerous advantages insimplifying configuring an audio interface for a speech recognitionapplication, particularly for connecting and adjusting one or moremicrophones and one or more audio output speakers. The microphone andspeaker setup taught herein can be used for other applications as well.This inventive arrangements simplify and expedite setting up an audiointerface in the following ways.

Step by step instructions are provided for connecting a microphone tovarious audio systems. The audio input is tested to determine that themicrophone is properly configured, in both power and signal parameters,to provide proper audio input and output.

Program flow is adapted depending on selection of the audio outputdevice, the microphone, the number of compatible sound cards and whetherany microphone connection adapters are available.

The microphone configuration and adjustments are designed to work withand for either dynamic and electret types of microphones.

Comparing background noise levels to speech levels allows operation overa wide range of microphones and audio systems.

The audio mixer is configured for speech recognition by selecting andadjusting microphone inputs, while at the same time, deselecting inputsand outputs as specific to each configuration that would otherwiseinterfere with microphone operation.

Multiple audio cards are supported, allowing the user to select betweenone or more audio cards for input and output. Mixer adjustments arebased on the audio card selection, and for each card separately.

Sound cards are tested in the system to insure that only those soundcards that meet the minimum requirements to support the speechapplication are listed for selection by the user.

The program flow is modified after the first time through the microphoneconfiguration process. Subsequent runs allow the user to bypass themicrophone hardware configuration tests and go directly to the audiomixer adjustments.

Graphic user interfaces and associated displays are designed to beeasily configured for different combinations of microphone andmanufacture-specific information.

A method for configuring an audio interface for a speech recognitionapplication in a computer system in accordance with an inventivearrangement comprises the steps of: (a) determining from a data storageregistry of said speech recognition application whether a microphoneoperatively associated with said computer system has been previouslysuccessfully set up for operation with said speech recognitionapplication; (b) displaying a first graphical user interface having afirst user activatable icon for setting up said microphone and a seconduser activatable icon for adjusting an audio recording level for saidmicrophone; (c) in the event said microphone is not registered as havingbeen previously successfully set up, altering said second icon inappearance and disregarding attempted activation of said second icon;and, (d) in the event said microphone is registered as having beenpreviously successfully set up, respectively initiating said setting upof said microphone and said adjusting of said audio recording levelresponsive to activation of said first or second icons respectively.

The method can further comprise the step of: (e) setting up saidmicrophone responsive to activation of said first icon in any one ofsteps (c) and (d) in conjunction with displaying at least one additionalgraphical user interface.

The method can still further comprise the step of: (f) redisplaying saidfirst graphical user interface as recited in step (b).

BRIEF DESCRIPTION OF THE DRAWINGS

There are shown in the drawings forms which are presently preferred. Itshould be understood, however, that the inventive arrangements are notlimited to the precise arrangements and instrumentalities shown.

FIG. 1 is a flow chart of a method, according to the inventivearrangements taught herein, for configuring an audio interface for aspeech recognition application in a computer system.

FIG. 2 is an exemplary screen display for a graphical user interfaceuseful for welcoming a user to a microphone setup process according tothe inventive arrangements.

FIG. 3 is an exemplary screen display for a graphical user interfaceuseful for selecting a sound card.

FIG. 4 is an exemplary screen display for a graphical user interfaceuseful for selecting a microphone type.

FIG. 5 is an exemplary screen display for a graphical user interfaceuseful for gathering information on microphone parts, with no partsselected.

FIG. 6 is the exemplary screen display for a graphical user interface asshown in FIG. 5, but with all microphone parts selected.

FIG. 7 is an exemplary screen display for a graphical user interfaceuseful for connecting the headset speaker plug to the computer system.

FIG. 8 is an exemplary screen display for a graphical user interfaceuseful for instructing a user in positioning and adjusting the headset.

FIG. 9 is an exemplary screen display for a graphical user interfaceuseful for testing audio playback.

FIG. 10 is an exemplary screen display for a graphical user interfaceuseful for explaining a first set of microphone connections.

FIG. 11 is an exemplary screen display for a graphical user interfaceuseful for explaining a second set of microphone connections

FIG. 12 is an exemplary screen display for a graphical user interfaceuseful for explaining a third set of microphone connections.

FIG. 13 is an exemplary screen display for a graphical user interfaceuseful for illustrating the connection in a headset speakerconfiguration.

FIG. 14 is an exemplary screen display for a graphical user interfaceuseful for illustrating the connection in an internal speakerconfiguration.

FIG. 15 is an exemplary screen display for a graphical user interfaceuseful for illustrating the connection in an external speakerconfiguration.

FIG. 16 is an exemplary screen display for a graphical user interfaceuseful for initiating a user interactive microphone test.

FIG. 17 is the exemplary screen display of FIG. 16 as a room noisesample is recorded.

FIG. 18 is the exemplary screen display of FIG. 16 as a speech sample isrecorded.

FIG. 19 is the exemplary screen display of FIG. 16 as indicating asuccessful microphone test.

FIG. 20 is an exemplary screen display for a graphical user interfaceuseful for providing instructions when the microphone test has failed.

FIG. 21 is an exemplary screen display for a graphical user interfaceuseful for explaining connection of a power adapter in a headsetconfiguration.

FIG. 22 is an exemplary screen display for a graphical user interfaceuseful for initiating a user interactive microphone test with the poweradapter in an external speaker configuration.

FIG. 23 is an exemplary screen display for a graphical user interfaceuseful for explaining connection of a battery adapter in a headsetconfiguration.

FIG. 24 is an exemplary screen display for a graphical user interfaceuseful for providing battery tips.

FIG. 25 is an exemplary screen display for a graphical user interfaceuseful for indicating completion of microphone connection.

FIG. 26 is an exemplary screen display for a graphical user interfaceuseful for initiating a user interactive audio level test.

FIG. 27 is the exemplary screen display shown in FIG. 26 during audiorecording.

FIG. 28 is the exemplary screen display shown in FIG. 26 as indicatingcompletion of audio level adjustment.

FIG. 29 is the exemplary screen display shown in FIG. 26 as indicatingno detection of audio input.

FIG. 30 is an exemplary screen display for a graphical user interfaceuseful for instructing a user to add the signal adapter, when no poweradapter is present.

FIG. 31 is an exemplary screen display for a graphical user interfaceuseful for instructing a user to add the signal adapter, when the poweradapter is already present.

FIG. 32 is an exemplary screen display for a graphical user interfaceuseful for instructing a user to remove the signal adapter, when nopower adapter is present.

FIG. 33 is an exemplary screen display for a graphical user interfaceuseful for instructing a user to remove the signal adapter, when thepower adapter is present.

FIG. 34 is an exemplary screen display for a graphical user interfaceuseful for initiating a user interactive speech recognition test.

FIG. 35 is the exemplary screen display of FIG. 34 during speechrecording.

FIG. 36 is the exemplary screen display of FIG. 34 as indicating afirst, second or third speech recognition failure.

FIG. 37 is the exemplary screen display of FIG. 34 as indicating afourth speech recognition failure.

FIG. 38 is the exemplary screen display of FIG. 34 as indicatingsuccessful completion of the speech recognition test.

FIG. 39 is an exemplary screen display for a graphical user interfaceuseful for explaining the connection and configuration of a genericheadset microphone.

FIG. 40 is an exemplary screen display for a graphical user interfaceuseful for explaining the connection and configuration of a genericdesktop microphone.

FIG. 41 is an exemplary screen display for a graphical user interfaceuseful for explaining the connection and configuration of a genericmonitor microphone.

FIG. 42 is an exemplary screen display for a graphical user interfaceuseful for explaining the connection and configuration of a generichand-held microphone.

FIG. 43 is an exemplary screen display for a graphical user interfaceuseful for instructing a user to exit from an incomplete microphonesetup.

FIG. 44 is an exemplary screen display for a graphical user interfaceuseful for advising a user that no active mixer device is available.

FIG. 45 is an exemplary screen display for a graphical user interfaceuseful for advising a user that no sound card was found.

FIG. 46 is an exemplary screen display for a graphical user interfaceuseful for advising a user an unsupported sound card was found.

FIG. 47 is an exemplary screen display for a graphical user interfaceuseful for advising a user that testing the microphone was unsuccessful.

FIG. 48 is a block diagram of a computer system that can be programmedwith a routine set of instructions for implementing the method andgraphical user interfaces in accordance with the inventive arrangements.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

FIG. 1 a flow chart of a method, according to the inventive arrangementstaught herein, for configuring an audio interface for a speechrecognition application, or program, in a computer system. The flowchart represents an automated sequence of controls referred to as aWizard in one or more commercial products embodying the inventivearrangements. The commercial products are the ViaVoice, VoiceType andIBM Simply Speaking speech recognition programs, available from IBM.ViaVoice, VoiceType, IBM Simply Speaking and IBM are trademarks ofInternational Business Machines corporation. The Wizard, which a tool,may be conveniently thought of as an intermediary or representative ofthe speech recognition application that guides a user through theconfiguring process in a thorough, efficient and user-friendly manner.Of course, the Wizard is part of the speech recognition applicationitself. FIGS. 2-48 represent so-called screen shots from one or more ofthe commercial products, that is, snapshots or downloads of graphicaluser interface monitor screen displays associated with different stepsand parts of the flow chart shown in FIG. 1. The screen shots in theprogram are protected by copyright. Copyright notices are found in theapplications but are omitted from the drawings herein. The inventivearrangements, therefore must be recognized as comprising various stepsof the method illustrated by the flow chart, various ones of thegraphical user interface displays, various sequences of the steps and ofthe graphical user interface displays and various combinations thereof.The inventive arrangements also comprise computer systems programmedwith a routine set of instructions stored in a physical medium forimplementing the various steps, graphical user interface displays,sequences and combinations thereof.

The flow chart in FIG. 1 illustrates the reasoning behind the sequencingof the method steps and graphical user interface displays, and conveys ahigh level view of the configuring process for the speech recognitionapplication. It is impractical to show all of the possible permutationsand combinations that may occur, or show all of the possible errorscenarios that may result in displaying various pop-up dialogs.Accordingly, it will be appreciated that the flow chart and thegraphical user interface displays shown in the drawings arerepresentative and need not be precisely as shown in order to fallwithin the ambit of the inventive arrangements taught herein.

Many of the graphical user interface (GUI) displays shown herein have afirst set of five icons representing so-called user activatable buttons,which the user can use to navigate through the application and theassociated tool. A first of these buttons is designated Back, forrepeating a step. A second of these buttons is designated Next formoving on to a following step. A third of these buttons is designatedCancel, for undoing a step in process, or in some cases, exiting fromthe application. A fourth button is designated Help, for initiating ahelp tool or utility. A fifth button is designated Finish, which can beused to accept the new settings made in accordance with the inventivearrangements. Only four of the buttons are used at the same time, theFinish button replacing the Next button when the Finish button isdisplayed.

Other GUI displays have a second set of two buttons user activatablebuttons, which are used for enabling a user to accept a certaincondition, situation or status. A first of these buttons is designatedOK, for accepting the certain condition, situation or status. A secondof these buttons is designated Help, for initiating a help tool orutility. The functions of these buttons will not be explained again inthe following descriptions of the GUI displays shown in the drawings.

With reference to FIG. 1, the flow chart represents a multi-path process10. Generally, only those arrows connecting the various blocks thatrepresent alternate decision paths are identified by reference numerals.The remaining paths are not so identified, except as noted. In broadterms, the method assures proper selection, connection and adjustment ofsound cards, microphones, microphone adapters, speakers and audiomixers, all of which represent part of an audio interface for the speechrecognition application, in a manner that is optimally compatible withoperation of the speech recognition application. It is that part of thespeech recognition application relating to this optimization that isembodied in the inventive arrangements taught herein. Speechrecognition, in and of itself, is beyond the scope of this disclosure.

The second block 12 is the first step perceived by a user and representsthe step of displaying a graphical user interface for welcoming the userto the speech recognition application, hereinafter referred to as theapplication. The GUI display 80 representing a Welcome page, shown inFIG. 2, presents some general information and informs the user of thepurpose of the Wizard tool. The GUI display 80 includes a messagesection 82 explaining the microphone set up and at least two useractivatable icons, for example so-called radio buttons 84 and 86. Themessage prompts the user to select one of two options by activating oneof the icons. The options include setting up the microphone to be usedfor speech recognition and adjusting the audio level of the words to berecorded and processed by the application.

At the same time, the tool will be gathering information by querying theaudio device driver for the sound card capabilities, setting up audiomixer controls and identifying all sound cards in the computer systemand determining which of those sound cards, if any, is compatible withthe application. Prior to the welcome step, or during part of the timethe welcoming step is undertaken, the audio mixer is initiallyconfigured in accordance with step of block 8. Without any interfacewith the user, and depending on the type of audio mixer, the tooldeselects or mutes the microphone playback mixer control and allrecording mixer controls other than the master and microphone controls.The tool then adjusts both the master and microphone volume controls tomaximum. This is the starting point for the various tests which follow.

If more than one sound card in the computer system is determined to bespeech capable, a GUI display 90 as shown in FIG. 3 is generated,corresponding to block 14, which can replace GUI display 80 on thescreen.

GUI display 90 includes a message section 92 identifying selection of asound card for input and output as the immediate task for the user, aswell as a first drop-down list 94 of those sound cards available for theinput of audio signals and a second drop-down list 96 of those soundcards available for the output of audio signals. In accordance with thecapabilities of the application and of the associated tool, the same ordifferent sound cards can be selected for the input and output of audiosignals. Once the sound cards have been selected, the GUI display 90 isreplaced by the Welcome page of GUI display 80. It will be appreciatedthat the sound card selecting step 14 can precede the welcome step 12,and that GUI display 90 can be formulated as an initial screen.

In the event only one suitable sound card is determined to be present,it must be used for both the input and the output audio signals, andaccordingly, no user interaction is required and no provision is madefor user interaction. In fact, the user need not even be aware thatselecting between multiple cards is an issue, so that avoiding evenraising the issue if unnecessary is an operational advantage of theinventive arrangements. In this circumstance, sound card selecting step14 is omitted.

Returning to GUI display 80, irrespective of the sound card selectingstep, a user unsophisticated in computer systems and speech recognitionapplications cannot reasonably be assumed to be aware that setting upthe microphone is a prerequisite to adjusting the audio level. Inaccordance with another operational advantage of the inventivearrangements, the tool determines from a data storage registry of theapplication whether a microphone operatively associated with theapplication has been previously successfully set up. If not, the audiolevel button 86 is deactivated and, for example, grayed in appearance asis common for unavailable options. This leaves the user with no choiceother than activating button 84 to initiate setting up the microphone.If the registry indicates that a microphone has previously beensuccessfully set up, then the user can activate either of the buttons 84and 86 to initiate either one of the microphone set up or the audiolevel adjustment. A user might choose to the microphone set up a secondtime if a new microphone has been installed or if previous operation wasdeemed to be unsatisfactory.

The actual updating of registry entries in the application occurs at twopoints in the process. The first point is after the microphoneconnection has been successfully tested, in block 46, so that the usercan exit from the application, if desired, without having to connect andtest the microphone again when the application is next used. The secondpoint is after the microphone setup has successfully concluded, in block52.

After the welcome step 12, and the sound card selecting step 14, ifnecessary, the type of microphone must be determined in step 16. A GUIdisplay 100 provides a drop-down list 102 of possible microphones, oneof which must be selected by the user. If the microphone is one whichhas been manufactured specifically for use with, and packaged with theapplication, referred to herein as a VoiceType microphone, the methodproceeds on path 18 to the gathering information step 22. A VoiceTypemicrophone is part of a headset assembly, illustrated for example inFIG. 4 and many other Figures, which also includes an ear piece. Thecable associated with the headset includes separate plugs for themicrophone and for the ear piece. The cables must be attached separatelyand may require different procedures and adapters. The microphone andthe ear piece will also require separate tests and adjustments. If themicrophone is not a VoiceType microphone, the flow chart branches onpath 20 to blocks 54 and 56 in succession. This path will be describedlater.

The gathering information step is implemented by a GUI display 110,shown in FIGS. 5 and 6. The tool will display the gathering informationdisplay 110 when the user clicks Next if the user has selected VoiceTypemicrophone in step 16. This display is be used to gather any additionalinformation that the user can provide. This information aids indetermining which branches of the flow chart 10 will be followed. FIG. 5shows a screen shot without any adapters selected and FIG. 6 shows ascreen shot with all of the adapters selected.

The static text field 114 in the Mixer Device group box 112 identifiesthe audio mixer device that the tool will be using. The name returnedfrom the mixer device driver is displayed in this field. A set 116 ofthree radio buttons 118, 120 and 122 is used to customize any microphonesetup diagrams that may be displayed in later screens. Buttons 118, 120and 122 also have an impact on the order and content of additionalscreens that can be added. Button 118 is for selecting externalspeakers. Button 120 is for selecting an internal speaker or speakers.Button 122 is for selecting a microphone headset, which includes atleast one ear piece. A user selecting internal or external speakers canuse the tool to test the audio playback, as explained later. A userselecting external or internal speakers can still choose to use amicrophone that is part of a headset, without reliance on the ear pieceassociated with the headset. These represent some of the combinationsand permutations that are too numerous to explain and illustrate indetail, but will be understood by those skilled in the art.

A third section 124 includes buttons with symbols representing differentparts, at least some of which are packaged with each application. Theseinclude a headset button 126, a signal adapter button 128, a poweradapter button 130 and a battery adapter button 132. The signal adapteris a signal strength attenuator having, for example, a ratio of 4:1.Some microphones require power at their tips and others require power attheir ring. Some sound cards provide power to the ring of a microphoneconnected thereto and others provide power to the tip. Some VoiceTypemicrophones require power to the tip. Sound cards of the Sound Blastertype supply power to the ring. Sound Blaster is a trademark of CreativeTechnology, Ltd. For use with such cards, the power adapter changes thepower from the ring to the tip. Some sound cards do not supply power atall for microphones or do not supply enough power for microphones. Thebattery adapter can supply such power when such sound cards are used.

The graphic push buttons are therefore used to help identify whatadapters may have been shipped with the VoiceType microphone. This is anelegant solution to the problem of the tool not knowing what kind ofmicrophone headset was shipped with the user's particular version of theapplication. Future versions of the application might ship with acustomized microphone that works with a particular sound card, requiringno adapters or a microphone similar to the one that shipped with amicrophone shipped with three different adapters. This can influence theflow of successive steps, as explained in the following example.

The user is prompted to unpack the headset and all of the parts packagedtherewith and to select each button corresponding to a supplied part. Ifthe tool determines, for example, that the computer is equipped with aSound Blaster type sound card and the user indicates that all thedisplayed extra components are available, as shown in FIG. 6, orindicates that at least the power adapter is available, then asubsequent Test With Power Adapter step in block 40 is advantageouslyimplemented before a Test Without An Adapter step in block 38 and beforea Test With Battery Adapter step in block 42, because most Sound Blastertype sound cards are known to require the power adapter, and the tool isprogrammed with this information.

If the user selected either internal or external speakers, the methodbranches on path 26 to a testing audio playback step and an adjustingthe headset step in blocks 34 and 36 successively. These steps will beexplained in detail later.

If the user selected the headset as the sound output device, the methodbranches on path 24 to a connect the headset speaker step in block 28. AGUI display 140 shown in FIG. 7 provides a picture 142 and text 144embodying instructions for correctly plugging in the headset to thecomputer system. The plug for the microphone, which is brightly coloredin other displays, for example green, is grayed to reduce confusion andemphasize the black speaker plug.

It cannot be assumed that all users are familiar with wearing headsets.Accordingly, the step in block 30 generates a GUI display 150, shown inFIG. 8, which provides a picture 152 and text 154 embodying instructionsfor properly wearing and mechanically adjusting the headset. The picture152 shows headset placement and mouth positioning. On-line Help isavailable by pressing the Help button if the user needs additionalinstruction. Alternatively, an animation sequence can be provided,demonstrating the whole procedure.

After the headset has been adjusted, audio playback can be tested in thestep of block 32. A GUI display 160 shown in FIG. 9 includes a useroperable volume control 162, an animation sequence 164 and a useractivatable button 166. GUI display 160 allows the user to set the audiooutput volume level to a comfortable level. Once the Test button 166 ispressed, audio will start playing. The button text will change to Stop,and the animation sequence 164 will begin. The animation sequence isprovided to give a visual indication that something is going on, in theevent the user may not be able to hear the audio being played, which canhappen for a variety of reasons. If the user hits the Stop button or theaudio plays to completion, the dialog text will be updated, the Stoptext will change to Re-Test and the animation sequence will stop. If theuser heard the audio test, and is satisfied with the volume level, theuser is instructed to press the Next button. Otherwise the user isinstructed to press the Help button for additional information.

Unseen to the user, the tool adjusts the master volume to maximum, makessure that the waveout is not muted and sets the waveout volume to eitherthe value in a Play Level registry entry of the application or thecurrent waveout mixer volume control, if the registry entry iscorrupted. If applicable, the microphone mixer controls are muted forplayback. The master mixer control and the wave out mixer control arenot muted, or are selected, depending on the type of audio mixer.

The branch beginning with path 24 terminates at the connect and testmicrophone step of block 38, as does the branch beginning with path 26.The testing audio playback step in block 34 is identical to the testingaudio playback step in block 32, except that is the internal or externalspeakers that are being tested, and accordingly, the headset speaker isof no concern, with regard to placement of the operation of the earpiece, which is not connected. Icons or pictures representative of theheadset need not be a part of any GUI display associated with the stepof block 34. No GUI display for this step in block 34 is necessary.However, since a VoiceType microphone was selected to reach path 18, thetool expects the microphone part of the headset to be utilized, even ifthe ear piece is not utilized. Accordingly, the headset is adjusted inthe following step of block 36, so that the microphone of the headsetwill be properly positioned for connecting and testing the microphone infollowing block 38. In block 38 the branches of the flow chart thatdiverged from the gathering information step of block 22 join backtogether.

The testing audio playback step of block 54 is associated with use of amicrophone that is not a VoiceType microphone. However, this microphoneselection is independent of the choice of a headset or internal/externalspeakers in the step of block 22. Accordingly, the testing audioplayback step of block 54 is the same as the steps in blocks 32 or 34,depending on the user selection of an audio output device.

Inasmuch as the tool has no access to information regarding the natureof the microphone tested for audio playback in the step of block 54, thenext step thereafter is to connect and test the microphone in the stepof block 56. Connecting and testing the microphone will be explained inconnection with the identical step of block 38.

In the connecting and testing microphone steps, blocks 38, 40 and 42represent three connection sequences, namely: the microphone alone; themicrophone with a power adapter; and, the microphone with a batteryadapter. For each of these connection sequences, the user is presentedwith a pair of screens to help the user test that sequence. The firstscreen of each pair describes to the user how to connect the microphonewith or without the adapter appropriate for the test. The second screenleads the user through the phases of the test. Within each sequence ofeach of the blocks 38, 40 and 42 the user tests various microphoneconfigurations through the series of paired test screens. Theconfigurations correspond to the selected audio output device, andinclude the headset configuration, the external speaker configurationand the internal speaker configuration. In the flow chart, the order ofconnection sequences is first the microphone alone, secondly themicrophone with a power adapter and thirdly the microphone with abattery adapter.

The order of these steps in the flow chart has been found to be the mostefficient sequence under most circumstances. However, it must beremembered that the tool is capable of changing this sequence undercertain circumstances. For example, and as explained in more detailabove, if the tool determines that the computer is equipped with a SoundBlaster type sound card and the user indicates that a power adapter isavailable, then the test with power adapter step in block 40 isadvantageously implemented as the first of the three connectionsequences because most Sound Blaster type sound cards are known torequire the power adapter. Generating GUI displays for connectingunneeded components is also advantageously avoided. Successfulcompletion of the connection and testing in block 40 under thesecircumstances makes it unnecessary for the steps of blocks 38 and 42 tobe implemented.

In the steps of block 38, the microphone must be connected before themicrophone connection can be tested. The user is reminded of connectionoptions prior to connecting the microphone. If the user has identified apower adapter, but not a battery adapter, in the information gatheringstep, a GUI display 170 shown in FIG. 10 will be generated. If the userhas identified a battery adapter, but not a power adapter, in theinformation gathering step, a GUI display 172 shown in FIG. 11 will begenerated. If the user has identified both a power adapter and a batteryadapter in the information gathering step, a GUI display 174 shown inFIG. 12 will be generated.

The next GUI display will also depend upon prior user selections. If theuser has identified and tested the headset as the audio output device,GUI display 190 shown in FIG. 13 is generated to illustrate connectionof the headset microphone. Both headset plugs are shown for connection.A detailed picture 192, in color, and clear instructions 194 simplifythe task. If the user has identified and tested the internal speaker asthe audio output device, GUI display 200 shown in FIG. 14 is generatedto illustrate connection of the headset microphone. Only the headsetmicrophone plug is shown for connection. No external speaker plug isshown. Detailed picture 202, in color, and clear instructions 204simplify the task. If the user has identified and tested externalspeakers as the audio output device, GUI display 210 shown in FIG. 15 isgenerated to illustrate connection of the headset microphone. Connectionof the headset microphone plug is shown, with an external speaker plug216 already in place. Detailed picture 212, in color, and clearinstructions 214 simplify the task.

A GUI display 220 shown in FIG. 16 is used to guide the user through thetesting procedure. The microphone test has two parts and the GUI display220 is modified as the test proceeds. The first part of the test isrecording only background, room noise levels. This is explained in amessage section 222. Visual feedback is provided via an animated icon ofa volume meter 224 and an icon of a tape recorder 226, which can beshown as not operating or can be animated to illustrate recording inprogress. At present, implementation of the volume meter is dependent onwhether the particular sound card/driver supports the peak meter mixerinterface of the Windows 95 platform. Windows 95 is a trademark ofMicrosoft corporation. An instruction section 228 provides userdirections. Finally, a user activatable Test button 230 is displayed toinitiate the test.

When the Test button has been activated, the bottom portion of the GUIdisplay is modified as shown in FIG. 17. The user is instructed toremain silent in section 228. The tape recorder undergoes an animationsequence illustrating the recording in progress. The volume meter movesas appropriate. After recording the room noise level, the recording isterminated and the corresponding animation of the tape recorder and thevolume meter is terminated.

In the next step, the GUI display 220 is modified as shown in FIG. 18.The user is instructed to recite a phrase into the microphone, forexample "I am testing my microphone setup." The text of the button 230is changed to Continue. Recording the phrase is initiated by pressingthe Continue button. The animation sequences of the tape recorder andthe volume meter begin again as the phrase is recited into themicrophone. After a predetermined amount of recording time, for exampleabout five seconds, the recording is terminated, as are thecorresponding animation sequences of the tape recorder and volume meter.

The tool then compares the signal level and noise level and determineswhether or not there was a valid microphone signal. If the test wassuccessful, the text in section 228 is modified to advise the user thatthe microphone test was successful and that the configuration processcan continue when the user activates the Next button, as shown in FIG.19. In the event the user chooses to retest the connection, the text ofthe button 230 is change to Re-Test. Activation of the Re-Test buttonwould return the user to GUI display 220 as shown in FIG. 16.

If the microphone test is successful, the flow chart branches on path 60to the step of block 46, which will be later explained in detail. If themicrophone test is not successful, GUI display 240 as shown in FIG. 20.GUI display 240 includes a picture 242 of the headset and microphoneplug as tested, to remind the user of the proper connection. Thispicture will differ, depending upon the user's prior selection of anoutput audio device. GUI display 240 also includes the tape recorderrepresentation 246 and a volume bar representation 244 as shown GUIdisplay 220 in FIG. 16. In the instruction section 248, the user isprovided with two options. One option is check the microphone plug forsecure attachment and to retest the microphone connection. The otheroption is to select the Next button to initiate a determination if thesound card requires an adapter.

If the retesting is successful, the process branches to the step ofblock 46 on path 60. If the retesting is unsuccessful, and no poweradapter or battery adapter was identified in the information gatheringstep, the process branches on path 64 to block 58, corresponding to afailure of the microphone connection with no adapter alternativesavailable.

If the retesting is unsuccessful or the user chooses not to retest, anda power adapter is available, the process moves to the step ofconnecting a power adapter and retesting the connection. If theretesting is unsuccessful or the user chooses not to retest, and nopower adapter is available, but a battery adapter is available, theprocess advantageously skips the step of block 40 and moves to the stepof connecting a battery adapter and retesting the connection in block42.

Assuming that testing the microphone alone was unsuccessful, and that apower adapter was identified, a GUI display 260 shown in FIG. 21instructs the user on connecting the power adapter. A detailed picture262 includes the power adapter 264. An instruction section 266 explainsthe connection. Activating the Next button returns the user to a GUIdisplay identical to GUI display 220 shown in FIG. 16, except that thescreen is titled Testing With Power Adapter. It will be appreciated thatpicture 262 will correspond to the audio output device selected by theuser, as is the case with many of the alternative screen displaysexplained above. It is unnecessary to illustrate these alternativescreens. The retesting proceeds as explained in connection with block40. If the retesting with the power adapter is successful, the processbranches on path 62 to block 46. If the retesting is unsuccessful, GUIdisplay 270 as shown in FIG. 22 is generated. GUI display 270 has apicture 272 showing the arrangement being tested, namely with a poweradapter. The picture 272 will differ in accordance with the selectedaudio output device. The steps associated with GUI display 270 are thesame as those explained in connection with GUI display 240. If theretesting is unsuccessful and no battery adapter is available, theprocess branches on path 66 to block 58. If the retesting isunsuccessful and a battery adapter is available, the process moves tothe connecting and testing with a battery adapter step of block 42.

In block 42, a GUI display 280 shown in FIG. 23 instructs the user onconnecting the battery adapter. A detailed picture 282 includes thebattery adapter 284. An instruction section 286 explains the connection.Even the polarity of the batteries is illustrated. Activating the Nextbutton returns the user to a GUI display identical to GUI display 220shown in FIG. 16, except that the screen title changes to Testing WithBattery Adapter. It will be appreciated that picture 262 will correspondto the audio output device selected by the user, as is the case withmany of the alternative screen displays explained above. It isunnecessary to illustrate these alternative screens. The retestingproceeds as explained in connection with block 40. If the retesting isunsuccessful, the process branches on path 68 to block 58. If theretesting with the battery adapter is successful, the process moves tothe step of battery tips block 44.

A GUI display 290 shown in FIG. 24 is displayed only if a batteryadapter was identified and the test with a battery adapter wassuccessful. GUI display 290 instructs the user in proper use of thebattery adapter, including expected battery life and preferred batterytypes. When the user clicks Next, the process moves to microphoneconnection complete step of block 46, which can also be a step directlyfollowing blocks 38, 40 and 56. A GUI display 300 shown in FIG. 25advises the user that the microphone connection is complete. GUI display300 is the final page of the microphone connection and testing, and canbe used to display any additional or closing information 302 to the userthat might be of value. At this point the user should be able to hearaudio playback, know how to position the microphone and have the correctmicrophone setup that allows the user to record audio using theVoiceType supplied microphone. Certain registry entries concerning themicrophone setup are updated, in the event the user chooses to exit fromthe program. The user is instructed to activate the Next button to moveto the adjusting audio level step of block 48.

Adjusting the audio recording level is guided by GUI display 310 shownin FIG. 26. GUI display 310 includes an animated volume bar 312, aninstruction section 314, a sample word section 320, a Start button 322and a Play Sample button 324. Instruction section 314 includes icons ofa microphone 316 and a volume control 318. The user is instructed toclick the Start button. In response to the start button, GUI display 310is modified as shown in FIG. 27. The user is instructed to say the sixwords listed in section 320 as they are highlighted by a colored pacerbox, for example blue, or box outline as shown. The volume bar 312 isanimated during the dictation to provide feedback to the user. Thevolume bar 312 is preferably one color to discourage users fromadjusting their voices if they notice that their voices are out ofrange. The user can see a demonstration of this process by clicking thePlay Sample button. If the test is successful, GUI display 310 ismodified as shown in FIG. 28. The user is advised that the audioadjustment is complete and is instructed to click the Next button tocontinue the process.

If no audio is detected after 5 seconds, GUI display 310 will bemodified as shown in FIG. 29. The instruction section 314 instructs theuser to seek Help or to restart the test. If audio is detected, but thetool is unable to properly adjust the audio, the user will be promptedto add or remove the signal adapter if the tool cannot adjust the volumeto an acceptable level by adjusting the mixer volume level. The userwill be instructed to add the signal adapter if the following conditionsare true: the user selected a signal adapter on the gatheringinformation step; and, the tool has lowered the mixer volume slider tothe bottom 5% of the maximum range. The user will be instructed toremove the signal adapter if the following conditions are true: theregistry in the application indicates that the user is currently usingthe signal adapter; and, the tool has raised the mixer volume slider to100% of the maximum range.

GUI display 330 shown in FIG. 30 will be displayed if no power adapteris being used. GUI display 330 provides pictorial and text instructionsfor adding a signal adapter 332 when no power adapter is present.Alternatively, the picture can be animated. GUI display 340 shown inFIG. 31 will be displayed if a power adapter is being used. GUI display340 provides pictorial and text instructions for adding a signal adapter342 when a power adapter 344 is present. Alternatively, the picture canbe animated. Two displays are necessary for adding the signal adapterbecause the signal adapter must be added at a specific location if thepower adapter is being used. In particular, the signal adapter must beconnected between the microphone plug and the power adapter. A similarGUI display, not shown, can be provided for adding the signal adapterwhen the battery adapter is used.

GUI display 350 shown in FIG. 32 will be displayed if no power adapteris being used. GUI display 350 provides pictorial and text instructionsfor removing a signal adapter 352 when no power adapter is present.Alternatively, the picture can be animated. GUI display 360 shown inFIG. 33 will be displayed if a power adapter 364 is being used. GUIdisplay 360 provides pictorial and text instructions for removing asignal adapter 362 when no power adapter is present. Alternatively, thepicture can be animated.

If the tool is unable to properly adjust the audio level, the processbranches to a block, not shown, which results in generation of anadvisory message that the adjusting audio level step is incomplete. Theuser is instructed on various options, including readjustment of thesound card parameters independently of the application and the tool.

If the audio level adjustment test is successful and the user clicks theNext button, the process moves to the test speech recognition step ofblock 50. GUI display 370 shown in FIG. 34 is generated to test speechrecognition, and includes a volume bar 372, an instruction section 374and a sample word section 376. The Start button 378 and the Play Samplebutton 380 have the same purpose as explained in connection with GUIdisplay 310 in FIG. 26. A new button 382 designated Finish replaces theNext button at the bottom of the display.

The user is provided with two options. One option is to save theadjusted audio levels and exit the application by clicking the finishbutton. Saving the adjusted audio levels is necessary because none ofthe adjusted settings is otherwise saved until the microphone setup hassuccessfully concluded in all expected manner. The other option is toclick the Start button to initiate testing speech recognition.

The application must try to recognize the words that the user isspeaking. If the application does not recognize a word then its color ischanged, for example from black to red. The six words are selectedbecause they are easily recognized by the application, and if the audiolevels are reasonably close to optimal, the words should all berecognized. When the Start button has been clicked, the words aresuccessively highlighted as shown in FIG. 35, and the user performs thesame speaking task as when adjusting the audio level, as explained inconnection with GUI display 310 shown FIGS. 26 and 27. The background ofGUI display 370 can be made a different color than GUI display 310 toavoid confusion with the earlier test. The audio level meter is animatedto change colors, for example, from solid blue to yellow/green/red togive the user feedback on how well the audio is adjusted. It is notnecessary to discourage users from adjusting their voices because allequipment and audio adjustments have already been made.

If the user receives red words in the test two things will occur. Thefirst three times it happens, the user will be prompted in theinstruction section 374 to repeat the test, as shown in FIG. 36. Thefourth time the test fails, the instruction section will be modified asshown in FIG. 37. The tool will suggest via on-line help that the usermay need to go through enrollment or check the user's audio system.

When the user successfully completes this task, a message is displayedin section 374 that the test was successful, as shown in FIG. 38,corresponding to the microphone setup successful step in block 52. Theuser is prompted to click the Finish button, in order to store all ofthe adjustments and respective registry entries of the application andto exit from the tool. Thereafter, the user can use the application forspeech recognition without further adjustment.

The branch beginning with path 20 does not include an adjusting headsetstep because the nature of the microphone is unknown to the tool. Sincenone of the adapters that might be necessary for use with the VoiceTypemicrophone can be suggested by the tool for use with the other kind ofmicrophone, the branch beginning with path 20 does not rejoin the restof the flow chart until a microphone passing result leads to block 46 oruntil a microphone failing result leads to block 58.

Referring back to connecting and testing the not VoiceType microphone inblock 56 of the branch starting with path 20, several GUI displays cannevertheless be generated that provide tips for connecting and usingvarious kinds of microphones. GUI display 380 shown in FIG. 39 providestips for connecting and using a generic headset microphone. GUI display390 shown in FIG. 40 provides tips for connecting and using a genericdesktop microphone. GUI display 400 shown in FIG. 41 provides tips forconnecting and using a generic monitor microphone. GUI display 410 shownin FIG. 42 provides tips for connecting and using a generic hand heldmicrophone. If the microphone test, which is the same as described inconnection with block 38 is successful, the process branches on path 70to block 46. If the microphone test is not successful, the processbranches on path 72 to block 58.

The microphone setup unsuccessful step of block 58, referred to above,generates the GUI display 480 shown in FIG. 47.

Throughout various stages of the process, certain conditions may bedetected, which require termination of the microphone setup, other thanfailure of the various tests explained above. GUI displays can beprovided for these situations. Some of these, but by no means anexclusive set, are also shown in the drawings.

A message 422 enables the user to exit the tool prior to the microphonesetup being successfully completed, for any of the number of failuresexplained above. If the user clicks the Yes button, the tool exits. Ifthe user clicks the No button, the Exit dialog is terminated and thetool returns to the setup process.

GUI display 430 shown in FIG. 44 informs the user that the computersystem does not have an active mixer device associated with thecurrently selected audio device. The user is presented with someinstructions and then prompted to click OK to exit from the tool.

GUI display 440 shown in FIG. 45 informs the user that no sound cardcould be found in the computer system. The user is prompted to click theHelp button for an Internet URL (web page) and/or a list of compatiblesound cards.

GUI display 450 shown in FIG. 46 informs the user that the tool detectedonly an unsupported sound card. If the user clicks OK, the tool exits.If the user clicks Help instructions are provided on where to findadditional information on how to resolve the problem.

A computer system 1 is shown in block diagram form in FIG. 48. Thecomputer system is programmed with a set of instructions stored in aphysical medium, for example a hard drive 7 and/or a random accessmemory (RAM) 5 of a central processor 3, for optimizing an audiointerface 29, 33 between one or more sound or audio cards 21 in thecomputer apparatus and each of a microphone 27 and a speaker 31.Microphone 27 is intended to represent, for example, a headsetmicrophone, a desktop microphone, a monitor microphone and a hand heldmicrophone. Speaker 31 is intended to represent, for example, one ormore internal speakers, one or more external speakers, one or moremonitor speakers or a headset speaker. The computer system 1 has agraphics adapter 9 that generates the GUI displays explained above andshown in FIGS. 2-48. The computer system further comprises a monitor 15,a keyboard 17 and a mouse 19. The dashed line box shown in random accessmemory 5 represents the process 10 of the flow chart shown in FIG. 2,and is intended to represent a programmed routine of instructions, inaccordance with the inventive arrangements, stored in a physical mediumembodied by hard drive 7 and loaded into another physical mediumembodied by random access memory 5. The programmed routine ofinstructions implements the steps of the configuring process as shownand described herein.

The numerous inventive arrangements disclosed herein provide numerousadvantages in simplifying configuring an audio interface, particularlyfor a microphone connection and adjustment for use with a speechrecognition application, although such a microphone setup can be usedfor other applications as well. This invention is unique in thefollowing respects.

Step by step instructions are provided for connecting a microphone tovarious audio systems. The audio input is tested to determine that themicrophone is properly configured, in both power and signal parameters,to provide proper audio input and output.

Program flow is adapted depending on selection of the audio outputdevice.

The microphone configuration and adjustments are designed to work withand for either dynamic and electret types of microphones.

Comparing background noise levels to speech levels allows operation overa wide range of microphones and audio systems.

The audio mixer is configured for speech recognition by selecting andadjusting microphone inputs, while at the same time, deselecting inputsand outputs as specific to each configuration that would otherwiseinterfere with microphone operation.

Multiple audio cards are supported, allowing the user to select betweenone or more audio cards for input and output. Mixer adjustments arebased on the audio card selection, and for each card separately.

Sound cards are tested in the system to insure that only those soundcards that meet the minimum requirements to support the speechapplication are listed for selection by the user.

The program flow is modified after the first time through the microphoneconfiguration process. Subsequent runs allow the user to bypass themicrophone hardware configuration tests and go directly to the mixeradjustments.

Graphic user interfaces and associated displays are designed to beeasily configured for different combinations of microphone andmanufacture-specific information.

What is claimed is:
 1. A method for configuring an audio interface for aspeech recognition application in a computer system, comprising thesteps of:(a) determining from a data storage registry of said speechrecognition application whether a microphone operatively associated withsaid computer system has been previously successfully set up foroperation with said speech recognition application; (b) displaying afirst graphical user interface having a first user activatable icon forautomatically guiding a user through a programmed procedure for settingup said microphone and a second user activatable icon for automaticallyadjusting an audio recording level for said microphone; (c) in the eventsaid microphone is not registered as having been previously successfullyset up, altering said second icon in appearance and disregardingattempted activation of said second icon; and, (d) in the event saidmicrophone is registered as having been previously successfully set up,respectively initiating said procedure for setting up of said microphoneand said adjusting of said audio recording level responsive toactivation of said first or second icons respectively.
 2. The method ofclaim 1, further comprising the step of:(e) initiating said procedureresponsive to activation of said first icon in any one of steps (c) and(d) in conjunction with displaying at least one additional graphicaluser interface.
 3. The method of claim 2, further comprising the stepof:(f) redisplaying said first graphical user interface as recited instep (b).
 4. A computer programmed with a routine set of instructionsfor configuring an audio interface for a speech recognition applicationstored in a physical medium, comprising:means for determining from adata storage registry of said speech recognition application whether amicrophone operatively associated with said computer system has beenpreviously successfully set up for operation with said speechrecognition application; means for displaying a first graphical userinterface having a first user activatable icon for automatically guidinga user through a programmed procedure for setting up said microphone anda second user activatable icon for automatically adjusting an audiorecording level for said microphone; means operable in the event saidmicrophone is not registered as having been previously successfully setup, altering said second icon in appearance and disregarding attemptedactivation of said second icon; and, means operable in the event saidmicrophone is registered as having been previously successfully set up,respectively automatically initiating said procedure for setting up ofsaid microphone and said adjusting of said audio recording levelresponsive to activation of said first or second icons respectively. 5.The computer of claim 4, further comprising:means for initiating saidprocedure for setting up said microphone responsive to activation ofsaid first icon; and, means for displaying at least one additionalgraphical user interface in conjunction with said microphone setting upmeans.